Edit Models filters

Inference Providers

Misc

GGUF

Inference Endpoints

4-bit precision

8-bit precision

Merge

text-generation-inference

text-embeddings-inference

Models

6,300

Full-text search

Active filters: GGUF

MaziyarPanahi/SciPhi-Self-RAG-Mistral-7B-32k-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 66 • 3

LiteLLMs/Hermes-2-Pro-Llama-3-8B-GGUF

Updated May 6, 2024 • 83 • 1

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 282k • 99

legraphista/Nxcode-CQ-7B-orpo-IMat-GGUF

Text Generation • Updated Jun 2, 2024 • 477 • 1

helizac/TURNA_GGUF

Text2Text Generation • Updated Jun 13, 2024 • 307 • 3

legraphista/shieldgemma-9b-IMat-GGUF

Text Generation • Updated Aug 5, 2024 • 251 • 1

tensorblock/gte-Qwen2-7B-instruct-GGUF

tensorblock/Llama-3-ELYZA-JP-8B-GGUF

Updated Apr 20 • 154 • 1

tensorblock/gemma-2-9b-it-DPO-GGUF

Updated Apr 20 • 86 • 1

tensorblock/Blue-Orchid-2x7b-GGUF

Updated Apr 21 • 302 • 1

Goekdeniz-Guelmez/Josiefied-Qwen2.5-Coder-14B-Instruct-abliterated-v1

Text Generation • Updated Feb 23 • 38 • 2

MaziyarPanahi/Slush-ChatWaifu-Chronos-GGUF

Text Generation • Updated Feb 10 • 38 • 1

tensorblock/DeepHermes-3-Llama-3-8B-Preview-GGUF

Updated Apr 21 • 100 • 1

kalle07/embedder_collection

tensorblock/Mistral-Small-24B-Instruct-2501-abliterated-GGUF

Updated Apr 21 • 256 • 2

DavidAU/Reka-Flash-3-21B-Reasoning-Uncensored-MAX-NEO-Imatrix-GGUF

Text Generation • Updated Mar 21 • 13.7k • 49

tensorblock/DeepHermes-3-Llama-3-3B-Preview-GGUF

Updated Apr 21 • 76 • 1

MaziyarPanahi/ReasonFlux-F1-14B-GGUF

Text Generation • Updated Mar 24 • 32 • 1

tensorblock/all-hands_openhands-lm-32b-v0.1-GGUF

Text Generation • Updated Apr 23 • 146 • 1

tensorblock/RWKV_v6-Finch-14B-HF-GGUF

Updated Apr 29 • 192 • 1

tensorblock/SmerkyG_rwkv-6-world-3b-GGUF

Updated Apr 30 • 217 • 1

kroonen/OpenOrca-Platypus2-13B-GGUF

Updated Aug 30, 2023 • 3 • 2

Mozilla/llava-v1.5-7b-llamafile

Updated Apr 1 • 6.9k • 183

Trelis/openchat_3.5-function-calling-v3

Text Generation • Updated Mar 6, 2024 • 20

TIGER-Lab/TIGERScore-7B-GGUF

Text2Text Generation • Updated Dec 5, 2023 • 24 • 2

TIGER-Lab/TIGERScore-13B-GGUF

Text2Text Generation • Updated Dec 5, 2023 • 13 • 1

cosimoiaia/Loquace-7B-Mistral-GGUF

Updated Dec 16, 2023 • 9 • 3